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Amendments to the Claims; 

Please cancel Claims 28 and 65. Please amend Claims 1,16, 26-27, 29,44,.46, 52, 54, 
58, 62-63, 66, 70 and 74. The Claim Listing below will replace all prior versions of the claims in 
the application: 

Claim Listing 

1 . (Currently amended) A computer i mplememed method for Synthesizing a data sequence 
representing figure or human motion, comprising ee mputer implomontod stops of ; 
defining a switching linear dynamic system (SLDS) comprising a plurality of dynamic 
models; 

associating each model with a switching state such that a model is selected when 
its associated switching state is true; 

detennining a state transition record for at least one training sequence of 
measurements by determining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 
training sequence, wherein the optimal prior switching siate optimiaes a transition 
probability; 

determining, for a final measurement, an optimal final switching state; 
determining the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition record; 

learning parameters of the dynamic models, responsive to the determined sequence of 
switching states; and 

synthesizing a new data seqixence, based on the dynamic models with learned 
parameters. 



(Original) The method of Claim 1, wherein the new data sequence has characteristics 
which are similar to characteristics of at least one training sequence. 

(Original) The method of Claim I, wherein the new data sequence combines 
characteristics of plural training sequences. 
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4. (Original) -nie method of Claim 1, fimher compri^mg modifying the StDS such that 
least one constraint is met, 

5. COriginal) The metfaod of Claim 4, wherein modifying the SUDS comprises: 
adding a continuous state controL 

6. (Original) The method of Claim 5, wherein modifying the SLDS further comprises: 
adding constraints on continuous states. 

7. (Original) The method of Claim 5, wherein modifying the SLDS funher comprises: 
adding constraints on the continuous state control. 

8. (Original) The method of Claim 5, wherein modifying the SLDS further comprises; 
adding constraints on time, 

9. (Original) The method of Claim 5, further comprising: 

designing an optimal continuous control that satisfies the at least one constraint. 

1 0. (Previously presented) The method of Claim 9, further comprising: 
synthesizmg the new data sequence using the optimal continuous control, 

1 1. (Original) The meihod of Claim 4, wherein modifying the SLDS comprises: 
adding a switching state control. 

12. (Original) The method of Claim 1 1 , wherein modifying the SLDS further comprises: 
adding constraints on switching states, ' 

13. (Original) The method of Claim 12, wherein modifying the SLDS further comprises: 
adding constraints on the switching state control. 

14. (Original) The method of Claim 12, further comprising: 
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designing an optimal switching control thai saiisfxes constraints. 

15. (Previously presented) The method of Claim 14. further comprising: 
synthesizing the new data sequence using the optimal switching control. 

16. (Cuitently amended) The method of Claim 4. ftoher comprising designing optimal 
switching and continuous state conttols that satisfy oontinuoua<ad switching aM 
continuous constraints re^ciively. 

17. (Previously presented) The method of Claim 16, fUnher comprising: 
synthesizing the new data sequence using the optimal switching and continuous state 
controls. 

18. (Previously presemed) The method of Claim 1, wherein the training sequence of 
measurements comprises economic data. 

19. (Previously presented) The method of Claim 1. wherein the training sequence of 
measurements comprises image data. 

20. (Previously presented) The method of Claim I, wherein the n-aining sequence of 
meastirements comprises audio data. 

21. (Previously presented) The method of Claim I. wherein the training sequence of 
measurements comprises spatial data. 

22. (Previously presented) Computer apparatus for synthesizing figure motion usmg a 
switching linear dynamic system (SLDS) model, and comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a state transition recorder which determines, for at least one training sequence of 
measurements, a state nransition record by determining and recording, for a given 
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measurement md for each possible switching state, m optimal prior switching state, 
based on the at least one training sequence, wherein the optimal prior switching state 
optimizes a transition probability, and which determines, for a fmal measurement, an 
optimal final switching state; 

a backtracker which deteimines a sequence of switching states corresponding to 
the training sequence by backtracking, from said optimal final switching state, through 
the state transition record; 

a dynamic model learner which learns parameters of the dynamic models 
responsive to the deteiroined sequence of swiwhing states; and 
a synthesizer which synthesizes a new data sequence, based on dynamic models with 
learned parameters. 

23. (Previously presented) Computer apparatus of Claim 22, wherein the new data sequence 
has characteristics similar to at least one training sequence. 

24. (Previously presented) Computer apparatus of Claim 22. wherein the new data sequence 
combines characteristics of plural training sequences. 

25. (Previously presented) A computer system for synthesizing a data sequence representing 
figure or human motion, comprising: 

means for defining a switching linear dynamic system (SLDS) comprising a 
plurality of dynamic models; 

means for associating each model with a switching state such that a model is 
selected when its associated switching state is true; 

means for deiennining a state transition record for at least one training sequence 
of measurements by determinihg and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on The at least one 
training sequence, wherein the optimal prior switching state optimizes a Transition 
probability; 

means for determining, for a final measurement, an optimal final switching state; 
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means for detennining the sequence of switching states by bwlar«clcing, from 
said optiinal final switcbine state, through the state transition record; 
means for learning parameters of the dynamic models, responsive to the detennined 
sequence of switching states; and 

means for synthesizing a new data sequence, based on the dynamic models with 
learned parameters. 

26 (Cmmently amended) A computer program product for synthesizing a data sequence 
representing figure or human motion, the Domputcr piogram produci comprising a 
computer tisabi« le^^^^e storage medium having computer rtiadablo exec^tahle code 
thereon, including program code which: 

defines a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associates each model with a switching state such that a model is selected when 
its associated switching state is true; 

determines a state transition record for at least one training sequence of 
measurements by deteimining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 
training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

determines an optimal final switching state for a final measurement; fland]]. 
determines the sequence of switching states by backtracking, from said optimal final 
switching state, through the state transition record; 

leains parameters of the dynamic models, responsive to the determined sequence of 
switching states; and 

synthesizes a new data sequence, based on the dynamic models with learned 
parameters. 

27. (Currently amended) A computer system for performing motion synthesis and 
interpolation comprising: 
a processor; 
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a memoiy system connected to the processor; and 
a computer prograra, in the memory, which: 

associates each of a plurality of dynamic models with a switching state such that a 
model is selected when its associated switching state is true; 

determines a state transition record for at least one training sequence of measurements by 
determining and recording, for a given raeasuremem and for each possible switching 
state, an optimal prior switching state, based on the at least one training sequence, 
wherein the optimal prior switching state optimizes a transition probability; 

determines an optimal final switching state for a finaJ measurement; [fand]] 
determines [[the]] a sequence of switching states by baclcttacking, from said optimal final 
switching state, through the state transition record; 

learns parameters of the dynamic models, responsive to the determined sequence 
of switching states; and 

synthesizes a new data sequence, based on the dynamic models with learned 
parameters. 



28. (Cancelled) 



(Cmremly amended) A computer implemenied method for synthesizing a data sequence 
representing figure motion, comprising oomputor iroplompntod otopa o f : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each dynamic model with a switching state such that a dynamic model 
is selected when its associated switching state is vrus, wherein the switching state at a 
particular instance is determined by a switching model; 

decoupling the dynamic models from the switching model; 

determining parameters of a decoupled dynamic model, responsive to a switching 
state probability estimate; 

estimating a state of a decoupled dynamic model corresponding to a measurement 
at the particular instance, and responsive to at least one training sequence of 
measurements; 
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detemjining parameters of the decoupled switching model, responsive to the 
dynamic state estimate; 

estimating a probability for each possible switching state of the decoupled switching 
model; 

determining a switching state sequence based on the estimated switching state 
probabilities; 

learning parameters of the dynamic models, responsive to the switching states 
sequence; and 

synthesizing a new data sequence, based on the dynamic models with learned 
parameters. 

30. (OriginalMhe method of Claim 29, wherein the new data sequence has characteristics 
similar to at least one training sequence. 

31 . (Original) The method of Claim 29, whetein the new data sequence combines 
characteristics of plural training sequences. 

32. (Previously presented) The method of Claim 29, Anther comprising modifying the SLDS 
such that at least one constraint is met, 

33. (Original) The method of Claim 32. wherein roodiiying the SLDS comprises: 
adding a continuous state control. 

34. (Original) The method of Claim 33, wherein modiiying the SLDS further comprises: 
adding constraints on continuous states. 

35. (Oiiginal) The method of Claim 33, wherein modifying the SLDS funher comprises: 
adding constraints on the continuous state control. 

36. (Original) The method of Claim 33, wherein modifying the SLDS fVmher comprises: 
adding constraints on time. 
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37. (Original) The method ofClaim 33. further comprising; 

designing m optimal continuous control that satisfies the at least one constraint. 

38. (Previously presented) The method of Claim 37, further comprising: . 
synthesizing the new data sequence using the optimal continuous control. 

39. (Original) The method of Claim 32, wherein modifying the SLDS comprises: 
adding a switching state contral. 

40. (Original) Tlie method of Claim 39, wherein modifying the SLDS further comprises: 
adding constraints on SAvitchhig states. 

41. (Original) The method of Claim 40, wherein modifi'ing the SLDS fUiTher comprises: 
adding constraints on the switching state control. 

42. (Original) The method ofClaim 40, further comprising: 
designing an optimal switching control that satisfies constraints. 

43. (Previously presented) The method of Claim 42, further comprising: 
synlhesizine the new data sequence using the optimal switching control. 

44. (Currently amended) The method of Claim 32, further comprising designing optimal 
switching and continuous state controls that satisfy continuoun and switching and 
continuQus constraints respectively. 

45. (Previously presented) The method of Claim 44, further comprising: 
syntiaesizing the new data sequence using the optimal, switching and continuous state 
controls. 
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46. (Currently amended) Computer apparatus for motion synthesis and inteipoJation using « 
switchins linear dynamic system (SLDS) model, comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a switching model which detennines values of the switching variable; 
an approximate variational state sequence inference module, which reesiimates 
parameters of each LDS model, using variational inference, to minimize a modeling cost 
of current state sequence estimates, responsive to at least one training sequence of 
measurements; an4 

a synthesizer which synthesizes a new data sequence, based on the reestimated 
d ynamic LDS modejs. 

47. (Previously presented) Computer apparaws of Claim 46, wherein the new data sequence 
has characteristics similar to the at least one training sequence. 

48. (Previously presented) Computer apparatus of Claim 46. wherein the new data sequence 
combines characteristics of plural training sequences. 

49. (Previously presented) Computer apparatus of Claim 46, fimher comprising modifying 
the SLDS such that at least one constraint is met. 

50. (Previously presented) Computer apparatus of Claim 49. wherein modifying the SLDS 

comprises: 

adding a continuous state control, 

51. (Previously presented) Computer apparatus of Claim 49, wherein modiiying the SLDS 
comprises: 

adding a switching state control. 
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(Currentjy amended) Computer apparatus of Claim 49, further comprising designing 
optimal switching and continuous state controjs that satisfy cominuouj and switching and 
continuQufi constraints respectively. 

(Previously presented) Computer apparatus of Claim 52. further comprising: 

synthesizing the new data sequence using the optimal switching and continuous 
state controls. 



54. (Cuixently amended) A computer iTT^pirmenTPd method for synthesizing figure motion by 
intfiipolating from an input measurement sequence, comprising oomputor implomonioJ 
ot e pa of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each model with a switching state such that a model is selected when 
its associated switching state is true; 

determining a state transition record by determining and i«cording. for a given 
measurement and for each possible switching state, an optimal prior switching state. ' 

based on at least one training measurement sequence, wherein the optimal prior 
switching state optimi2:es a transition probability; 

detennimng, for a final measurement, an optimal fmal switching state; 

determining the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition reconJ; 

determining the sequence of continuous states based on the detennined sequence 
of switching states; and 

interpolating missing motion data from the input measuremenr sequence, based on 
dynamic models and responsive to the detennined sequences of continuous and switching 



55. 



states. 



(Original) The method of Claim 54. further comprising modifying the SLDS such that at 
least one constraint is met. 
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56. (Original) The method of Claim 55, wherein modifying the SLDS comprises: 
adding a continuous state control. 

57. tOrigi^^ai) The method of Claim 55. wherein modifying the SLDS comprises: 
adding a switching state control. 

58. (CuirenUy amended) The method of Claim 55. fimher comprising designing optimal 
switching and continuotjs state controls that satisfy oontinuouo tmd switching and 
continuiaug constraints i«spectively. 

59. (Previously presented) The method of Claim 58, further comprising: 
intetpolating the new data sequence using the oprimal switching and continuous state 
controls. 

60. (Original) The method of Claim 54, iiirther comprising: 

at a receiver, interpolating missing frames from transmitted model parameters and 
from received key frames, the key frames having been detennined based on the leaijjed 
parameters, wherein the input measurement sequence comprises the received key frames. 



(Previously presented) Computer apparatus for motion synthesis and interpolation using a 
switching linear dynamic system (SLDS) model, comprising; 

a pluraUty of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a state transition recorder which deteimines a state transition record for a training 
measuremem sequence by determining and recording, for a given measurement and for 
each possible switching state, m optimal prior switching state, based on the training 
sequence, wherein the optimal prior switching state optimizes a transition probability, 
and which determines, for a final measurement, an optimal final switching state; 

a backtracer which determines a sequence of switching states corresponding to the 
training sequence by backtracking, from said optimal final switching state, through the 
state transition record; 
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a dynamic model leanier wbich learns pai^meters of me dynamic niodels 
responsive lo the detennined sequence of switching states; and 

an interpolator which interpolates missing motion data from an input sequence, 
based on the dynamic models with learned parameters. 

(Currently amended) A computer system for synthesizing figure motion by interpolating 
from an input measurement sequence, the system comprising: 

means for defining a switching Unear dynamic system (SLDS) comprising a 
plurality of dymnuc models; 

means for associating each model with a switching state such that a model is 
selected vslien its associated switching state is true; 

means for deteimining a state transition record by determining and recording, for a given 
measurement and for each possible switching state, an optimal prior switching state, 
based on at least one training sequence, wherein the optimal prior switching state 
optimizes a transition probability; 

means for determining, for a fmal measurement, an optimal final switching state; 
means for detennining the sequence of switching states by backtracking, from said 
optimal final switching state, through the state transition record; 

means for learning parameters of the dynamic models, responsive to the 
detennined sequence of switching states; and 

means for inteipolating missing motiou data from the input measurement 
sequence, based on dynamic models learned fit»m ttaining sequences. 

63. (Cuirentiy amended) A computer program product for synthesizing figure motion by 
interpolating fix>m an input measurement sequence, the computer program product 
comprising a computer usabte readable storai7« medium having computer reodablo 
executable code thereon, including program code which: 

associates each of a plurality of dynamic models with a switching state such that a 
model is selected when its associated switching state is true; 

determines a state tcansition record by detennining and recording, for a given 
measurement and for each possible switching state, an optimal prior switching state. 
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based on at least one txMmng measurement sequence, wherein the optimal prior switching 

state optimizes a transition probability; 

deterniines an optimal final switching state for a final measuremem; [[and]] 
determines the sequence of switching states by backtracking, from said optimal 

final switching state, through the state transition record; 

learns parameters of the dynamic models, responsive to the determined sequence 

of switching stales resulting, and 

interpolates missing motion data from the input measurement sequence, based on 
the dynamic models with leaxned parameters. 

64. (Previously presented) A computer system for motion synthesis and interpolation 
comprising: 

a processor; 

a memory system connected to the processor; and 
a computer program, in the memory, which: 

associates each of a plurality of dynamic models with a switching state such that a 
model is selected when its associated switching state is true; 

determines, fi-om a set of possible switching states and respojjsive to a trdining 
sequence of measurements, a state transition record by determining and recording, for a 
given measurement and for each possible switching state, an optimal prior switching 
state, wherein the optimal prior svwtching state optimizes a transition probability; 

determines an optimal final switching state for a final measurement; 

determines a sequence of switching states corresponding to the measurement 
sequence by backtracking, fi-om said optimal final switching state, through the state 
transition record; 

learns parameters of the dynamic models, responsive to the determined sequence 
of switching states; and 

interpolates missing motion data fiom an input sequence, based on the dynamic 
models with learned parameters. 



65. (Cancelled) 
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66. (Currently amended) A computer impIem^nt^H method for synthesizing motion by 

inte^lating from an input measurement sequence, comprising <»fHnputer iroplomcmtod 
stops of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each dynamic model with a switching state such that a dynamic model 
is selected when its associated switching stare is tme, wherein the switching state at a 
particular instance is determined by a switching model; 
decoupling the dynamic models from the switching model; 

determining parameters of a decoupled dynamic model, responsive to a switching 
state probability estimate; 

estimating a state of a decoupled dynamic model corresponding to a measurement 
at the particular instance, and responsive to at least one training sequence of 
measurements; 

determining parameters of the decoupled switching model, responsive to the 
dynamic state estimate; 

estimating a probability for each possible switching state of the decoupled 
switching model; [[and]] 

determining the sequence of switching states based on the estimated switching 
state probabilities; 

learning parameters of the dynamic models, responsive to the determined 
sequence of switching states; and 

interpolatine missing motion data fiom the input measurement sequence, based on 
the dynamic models with learned parameters. 

67, (Original) The method of Claim 66, forther comprising modifying the SLDS such that at 
least one constraint is met. 

68. (Original) The method of Claim 67, wherein modifying the SLDS comprises: 
adding a continuous state control. 
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(Original) The method of Claim 67, wherein modifying the SLDS comprises; 
adding a switching state control 



(Currently aniended) The method of Claim 67, fwiber comprising designing optimal 
switching and continuous state controls that saiisiy continuouo ond switching and 
continuous constraints respectively. 

(Previously presented) The method of Claim 70, further comprising: 

, synthesizing the new data sequence using the optimal switching and continuous 
state controls. 

(Original) The method of Claim 66, wherein the raeasuremem sequence comprises a 
sparsely observed image sequence. 



(Original) The method of Claim 66, further comprising: 

at a receiver, interpolating missing frames from transmitted model parameters and 
from received key frames, the key frames having been determined based on the learned 
parameters. 



(CurrenUy amended) Computer apparatus for motion synthesis and interpolation using a 
switching linear dynamic system (SLDS) model, comprising: 

a plurality of Unear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a switching model which determines values of the switching variable; 
an approximate variational state sequence inference module, which reestimates 
parameters of each [[SLDS]] LDS model, using variational inference, to minimize a 
modeling cost of current state sequence estimates; 

a dynamic model learner which learns parameters of the d3'namio LDS modek 
responsive to [[the]] determined sequence of switching states resulting from at least one 
training sequence; and 
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an inteipolator which inteipoktes missing morion dm from an input sequence, 
based on ibe dynamic models with learned parameters. 



'J 
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